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•  To  Test  Effectiveness  of  Non-lethal  Weapons 
and  Systems 

-  “Testing  with  real  humans  can’t  be  done” 

-  “Testing  with  humans  is  expensive  and  time 
consuming” 

-  “To  extrapolate  model  from  crowd  laboratory 
findings” 


UNCLASSIFIED  -  Approved  for  Public  Release 
TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


Laboratory  Crowd  Behavior 


BDEOOM 


,  National 
Quality 
Award 

2007  Award 
plant 


UNCLASSIFIED  -  Approved  for  Public  Release 

TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


•  Based  on  the  work  of 
Kurt  Lewin 


•  Field  Theory  in  Social 
Science  ( 1 948) 

•  Principles  of 
Topological  Psychology 
(1936) 
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Conceptualization  of  Behavior 


•  B=f(P,E)  Behavior  is  a  function  of  the  Person  and 
the  Environment 

•  Behavior  can  be  expressed  in  mathematical  terms 

-  Easily  imported  into  modeling  and  simulation  exercises 

•  The  challenge  to  researchers  is  to  identify  the  totality 
of  relevant  factors  and  the  elimination  of  extraneous 
factors 
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•  Crowd  member’s  behavior  is  influenced  by  what  is 
thinking  and  feeling 

•  What  a  crowd  members  is  thinking  and  feeling  is 
influenced  by  what  is  seeing  and  hearing 

•  Other  people  in  the  crowd  and  the  control  force  are 
what  the  person  is  seeing  and  hearing 

•  The  physical  environment  mediates  what  the 
persons  sees  and  hears  from  the  others  in  the 
crowd  and  the  control  force. 
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•  Modeling  and  simulation  of  what  the  crowd 
member  is  PERCEIVING  is  critical  to 
modeling  COGNITION,  EMOTION,  & 
BEHAVIOR 

•  What  each  person  in  the  crowd  is  seeing 
and  hearing  is  critical  to  predicting  the 
crowd’s  behavior 
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Factors  in  Crowd  Response  to 
Non-lethal  Weapons  and  Systems 


•  Weapon  Variables: 

•  Visibility  (can  you  see  it) 

•  Predictability  (can  you  tell  where  it’s 
going  to  hit) 

•  Controllability  (can  do  something  to 
avoid  being  hit) 

•  Ability  (“Effects”  damage  to  persons) 


Individual  Psychological 
Factors: 

Motivation  toward  forbidden 
goal 

Competing  motivations 


Crowd  Social  Factors: 


•  Environmental  Factors: 

•  Cover 

•  Escape  Routes 

•  Barriers 
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•  Organizational  Hierarchy 

•  Interpersonal  Attraction 

•  Alignment  of  motivations  (do 
they  all  want  the  same  thing) 
Communication  Ability 
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Decision  Making 

Predictive/Normative  M&S 

Validation  and  Verification  of 
Model  is  Critical 

Third  Person 

Efforts  directed  at  gathering 
data  to  maximize  validity  of 
model 


Training 

Descriptive  M&S 

Perceptual  Realism  is 
Critical 

First  Person 

Efforts  directed  at  making 
user  interface  as 
perceptually  rich  as  possible 
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•  Decide  variable  of  interest 
“predicted”/”independent  variable’VOUTPUT 

•  Propose  a  lot  of  factors  that  may  be  important  in 
predicting  that  variable  “predictors”/”dependent 
variables”/!  N  PUT 

•  Find  ways  to  measure  each  variable  or  identify 
repositories  of  data  on  these  variables 

•  Subject  data  to  statistical  procedures  that  generate 
association  among  variables 


UNCLASSIFIED  -  Approved  for  Public  Release 
TECHNOLOGY  DRIVEN.  WARFIGHTER  FOCUSED. 


Data  Crunching  Yields  Specific 
Algorithms  and  Constants 


•  GATHER  DATA 

-  Metrics  for  input  variables 

-  Metrics  for  output  variables 

•  Conduct  preliminary  exploratory 
analyses 

-  Remove  factors  that  don’t  predict 

-  Check  for  interaction  effects 

-  Identify  possible  moderators 
Identify  mediators 

5 ~P[D)rD)ll  ±  UNCLASSIFIED  -  Approved  for  Public  Release 
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GATHER  EVEN  MORE  DATA 

Conduct  confirmatory  analyses 

-Test  hypotheses  based  on  exploratory 
analyses  (or  theory  or  previous  work...) 

-  Derive  equations  that  may  reliably  predict  the 
behavior 
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RnFcoM*  Algorithms  for  M  &  S 


•  y=|31X1+P2X2+  P3X3+...p12X1X2...+£ 


•  “Behavior  is  a  weighted  function  of 
variable  x1f  x9,  Xo  their  interactions,  and 

„  1  z  J  xl 

error. 


•  y  is  Output 

•  x  are  Inputs  (Weapons,  Environment, 
Individual,  and  Crowd  Social  Factors) 
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•  y=P1X1+P2X2+  P3X3+  P12X1X2...+£ 

y=  how  fast  person  is  running  away  (Individual  Output  Metric) 

x.,=  how  afraid  of  pain  person  is  (Individual  Psych  Input) 

x2=  how  many  friends  present  (Crowd  Social  Input) 

x3=  walls  present  (Environmental  Input) 

x4=  can  perceive  weapon  (Weapon  Input) 

x1  x2  =  how  afraid  of  pain  he  is  when  with  friends  (Interaction) 

P=how  much  this  variable  matters 

e=error  term 
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Verification  is  defined  as: 


The  process  of  determining  that  a 
model  or  simulation  implementation 
accurately  represents  the  developer’s 
conceptual  description  and  specifica¬ 
tion.  Verification  also  evaluates  the 
extent  to  which  the  model  or  simula¬ 
tion  has  been  developed  using  sound 
and  established  software  engineering 
techniques. 
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In  short,  verification  addresses  the  question 
“Have  we  built  the  model  right?1’ 


Cook  &  Skinner,  2005 


The  Journal  of  Defense  Software  Engineering 
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•  Need  to  articulate  specific  model 

-  List  of  relevant  factors 

-  Interrelationships  among  the  factors 

•  Need  to  articulate  assumptions 

-  Identify  relevant  scenarios 
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TARGET  RESPONSE 


Incapacitation 
Emotion  Display 
Fight  Response 
Flight  Response 


Bystanders  in  visual  contact 
Bystanders  within  earshot 
Bystanders  far  away 


Bystanders  in  visual  contact 
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Bystanders  far  away 


Bystanders  in  visual  contact 
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Bystanders  in  visual  contact 
Bystanders  within  earshot 
Bystanders  far  away 


Bystanders  in  visual  contact 
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Validation  is  defined  as: 

The  process  of  determining  the 
degree  to  which  a  model  or  simula¬ 
tion  is  an  accurate  representation  of 
the  real  world  from  die  perspective  of 
the  intended  uses  of  the  model  or 
simulation. 

Validation  considers  the  question  ':Have  wTe 
built  the  right  model?'’ 


Cook  &  Skinner,  2005 

The  Journal  of  Defense  Software  Engineering 
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Need  to  make/use  against  real  world 
observations 

•  Challenge  is  to  measure 

•  Challenge  is  to  find  recorded  measures 

•  Beware  of  circularity 

-  Can’t  use  same  data  that  you’ve  built  the 
model  for  validation 

•  Requires  control  over  factors 
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Thu  6  Aug  10:30-10:55  PM  Monroe 

“Social  Network  Analysis  of  Crowds” 


Thu  6  Aug  2:30-2:55  PM  Madison 

"Results  from  Experimentation  on  Driver  Behavior  at 
Controlled  Entry  Points" 


Thu  6  Aug  5:00-5:25  PM  Grand  Dominion  3 

"Empirical  data  sets  for  agent  based  modeling  of  crowd 
scenarios" 


Thu  6  Aug  4:00-4:25  PM  Grand  Dominion  4 

"Data  Sources  for  Human  Behavior" 
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Thu  6  Aug  5:00-5:25  PM  Grand  Dominion  4 


"Subject  Matter  Experts  from  Academia” 
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immEGOMjp  Conceptual  Model  for  Crowd 

Behavior 


Theoretical  Model 

Mechanisms  of  Non-Lethal  System  Effects  on  Crowd  Members 
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•  Technical  Reports 

-  DTIC 

-  NTIS 

-  May  be  too  specific 

-  May  not  include  social  science  information 

•  Books/Textbooks 

-  Academic  Library  Catalogs 

•  Journal  Articles 

*  "  Abases 
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•  Theories 

•  Identification  of  variables 

•  Associations  among  variables 

•  However,  these  type  of 
information  sources  are  unlikely  to 
have  algorithms  or  constants 
specific  enough  for  a  model 
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•  Public  Archives  of  Survey/Census  Data 

-  Pro:  Nice  clean  data  ready  for  analyses 

-  Con:  Need  to  search  for  relevant  metrics  measures 

•  Questionnaire/Interview  with  participants  (Retrospective) 

-  Pro:  Relatively  easy  to  collect  data 

-  Con:  Forgetting/Distortion/Bias 

•  Analysis  of  Videorecordings  of  Events 

-  Pro:  Relatively  easy  to  buy  data 

-  Con:  Coding  not  established,  biased,  and  limited  view 
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The  Search  for  the  Algorithm: 
Data  Sources:  Hard  Core 


Real-Time  Observation  or  Interview 

-  Pro:  Validity  of  data 

-  Con:  Relatively  difficult  to  collect  data,  have  to  wait  for 
event 

Controlled  Laboratory  Experiments 

-  Pro:  Customizable  control  of  factors 

-  Con:  External  validity  may  be  weak 

Natural  Experiments/Real-Time  Observation  or  Interview 

-  Pro:  Validity  of  data  /  control  of  factors 

-  Con:  Rare  to  have  events  that  differ  in  small  number 
of  factors  you  are  interested  in 
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